Peer review as a reputation system
نویسندگان
چکیده
This work presents our first steps towards analyzing the effects a reputation system would have over science production and evaluation as an alternative to the classical peer review process. Two agentbased simulation models have been built that place a different quality control system on the process of paper production, reading and publication. An open discussion about the stylized facts that can be used to feed and validate both models is also provided.
منابع مشابه
A New Reputation Model for P2P Network Based on Set Pair Analysis
P2P reputation systems are useful to evaluate the trustworthiness of peers and to combat malicious and selfish peer behaviors. The reputation system assigns each peer a global reputation scores through collecting locally generated peer feedbacks and aggregation. In traditional reputation system, a peer will rate the other by a score, after finished a transaction, No more detail of transaction a...
متن کاملGGRA: a grouped gossip-based reputation aggregation algorithm
An important issue in P2P networks is the existence of malicious nodes that decreases the performance of such networks. Reputation system in which nodes are ranked based on their behavior, is one of the proposed solutions to detect and isolate malicious (low ranked) nodes. Gossip Trust is an interesting previously proposed algorithm for reputation aggregation in P2P networks based on t...
متن کاملWho Took Peer Review Seriously: Another Perspective on Student-Generated Quizzes
In educational peer-review activities, one challenge is to tell which peer reviews are credible. Reputation systems are one approach. However, they work best in a scenario where (i) most of the peer reviewers can do a decent job, or (ii) reviewers tend to do peer-reviews in fixed styles─e.g., negative reviewers are negative on all artifacts they review; accurate reviewers grade all work accurat...
متن کاملThe Role of Initial Input in Reputation Systems to Generate Accurate Aggregated Grades from Peer Assessment
High-quality peer assessment has many benefits. It can not only offer students a chance to learn from their peers but also help teaching staff to decide on grades of student work. There are many ways to do quality control for educational peer review, such as a calibration process, a reputation system, etc. Previous research has shown that reputation systems can help to produce more accurate agg...
متن کاملOpen Peer Review: Notes On Reputation
Institutional and multidisciplinary open access repositories play a crucial role in knowledge transfer by enabling immediate accessibility to all kinds of research output. One important element still missing from open access repositories, however, is a quantitative assessment of the hosted research items that will facilitate the process of selecting the most relevant and distinguished content. ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2016